Analyzing Two Automatic Latent Semantic Analysis (LSA) Assessment Methods (Inbuilt Rubric vs. Golden Summary) in Summaries Extracted from Expository Texts
نویسندگان
چکیده
منابع مشابه
New algorithms assessing short summaries in expository texts using latent semantic analysis.
In this study, we compared four expert graders with latent semantic analysis (LSA) to assess short summaries of an expository text. As is well known, there are technical difficulties for LSA to establish a good semantic representation when analyzing short texts. In order to improve the reliability of LSA relative to human graders, we analyzed three new algorithms by two holistic methods used in...
متن کاملAssessing short summaries with human judgments procedure and latent semantic analysis in narrative and expository texts.
In the present study, we tested a computer-based procedure for assessing very concise summaries (50 words long) of two types of text (narrative and expository) using latent semantic analysis (LSA) in comparison with the judgments of four human experts. LSA was used to estimate semantic similarity using six different methods: four holistic (summary-text, summary-summaries, summary-expert summari...
متن کاملEvaluation of Narrative and Expository Text Summaries Using Latent Semantic Analysis
In this chapter I approach three automatic methods for the evaluation of summaries from narrative and expository texts in Spanish. The task consisted of correlating the evaluation made by three raters for 373 summaries with results provided by latent semantic analysis. Scores assigned by latent semantic analysis were obtained by means of the following three methods: 1) Comparison of summaries w...
متن کاملTransforming LSA space dimensions into a rubric for an automatic assessment and feedback system
The purpose of this article is to validate, through two empirical studies, a new method for automatic evaluation of written texts, called Inbuilt Rubric, based on the Latent Semantic Analysis (LSA) technique, which constitutes an innovative and distinct turn with respect to LSA application so far. In the first empirical study, evidence of the validity of the method to identify and evaluate the ...
متن کاملUsing Latent Semantic Analysis to Grade Brief Summaries: 2
A study exploring texts at different academic levels. Abstract 26 27 In this study we propose an integrated method to automatically evaluate very brief 28 summaries (around 50 words) using the computational tool Latent Semantic Analysis 29 (LSA). The method proposed is based on a regression equation calculated with a corpus 30 of a hundred summaries (the training sample), and is validated on a ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Psicología Educativa
سال: 2018
ISSN: 1135-755X,2174-0526
DOI: 10.5093/psed2048a9